Papers with adversary-aware DPO loss
Adversary-Aware DPO: Enhancing Safety Alignment in Vision Language Models via Adversarial Training (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Adversary-aware DPO (ADPO) is a training framework that explicitly considers adversary. |
| Approach: | a new framework integrates adversarial training into a pre-trained large language model to enhance safety alignment . adversary-aware DPO provides a framework that explicitly considers adversary . |
| Outcome: | a new training framework outperforms baselines in safety alignment and general utility of large language models. |